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ABSTRACT 

Five premises necessary for the formulation of 
instructional theory are stated. As a suggested elaboration of the 
"behavior classification" premise, a two-way (content and behavior) 
classification scheme for higher order tasks is described. The 
content dimension includes paired associate, concept, principle, and 
problem tasks. The behavior dimension includes discriminated recall, 
classification, rule using, and higher rule using. Each two-way 
category is illustrated by treatments from recent research on higher 
order tasks. As a suggested elaboration of the "manipulation of task 
variables" premise, a taxonomy of task variables is described. The 
taxonomy is divided into qualitative variables and quantitative 
parameters. The former include the major categories of presentation 
form, interdisplay relationships, and mathemagenic information (i,e, 
information designed to promote behavior which gives birth to 
learning) , Parameters include major categories of sequence, quantity, 
and pace. Research investigating some of the variables in the 
taxonomy is described and critiquedir and some additional needed 
research is suggested, A final section indicates implications of this 
research and the task taxonomy for instructional development, 
(Author) 
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Within the past few years, a major portion of the money available for 
educational Improvement has been channeled Into the systematic development 
of Instructional systems and products. Several books and manuals have 
appeared giving guidance to potential developers of Instructional systems. 
(Brlggs, 1970; Popham & Baker, 1970; Gerlack & Ely, 1971; Kemp, 1971; 
Merrill, 1971a). While each varies In terminology and detail, every position 
includes the following components: behavioral objectives, pretest. Instruc- 
tional activities, po'sttest, and revision based on empirical tryouts. This 
model was first given widespread exposure by Robert Glaser In his papers 
describing the emerging field of Instructional psychology (Glaser 1965, 1966). 

Merrill (1972a, 1972b) suggested that the following premises underlie 
this basic model: 

Premise 1 : Objectives must be specified In terms of observable 



Premise 3: Instructional products must be verified by empirical procedun 



student behavior. 



Premise 2: 



Testing Instruments should measure the student's ability 
to perform specified behavior (criterion referenced) rather 
than how well he performs In comparison with other students 
(norm referenced). (See Glaser 1963; Glaser & Klaus, 
1962; and Glaser & Nltko, 1971) 
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The paucity of research related to these basic premises suggests that they 
are considered axiomatic by most instructional developers. Numerous prop- 
ositions have been suggested for each of these statements, but there are 
only a handful of rather poorly executed studies testing them. Space re- 
strictions prevent a detailed review of this area (e.g. studies related to 
behavioral objectives include the following: Mager & McCann, 1961; McNeil^ 
1967; Baker, 1969; Horton, 1969; Cook, 1970; Oswald, 1370; Dalis, 1970; 
Jenkins & Deno, 1971; Jenkins & Nelsworth, 1971; Paul Merrill, 1971; Hiscox 
& Herron, 1971; Pratt, 1971; Rosen, 1971). 

Most instructional development efforts can be characterized by a 
"raw empiricism" approach. Instructional materials are prepared based on 
Intuition, folklore, and experience. These materials are then administered to 
.members of the target population. If the students pass the test, the product 
Is considered appropriate; If not, the materials are revised and tried again. 
This tryout-revlslon cycle Is repeated until the product works or the developers 
run out of resources or time . 

Progress cannot be made toward an empirically based Instructional 

development methodology until propositions that relate objectives to learning 

activities are specified and tested. In order to state such propositions, It 

Is necessary to propose at least two additional premises: 

Premise 4 : Instructional outcomes can be classified Into a limited 
number of behavioral classes. 

Premise 5 : The acquisition of a given kind of behavioral outcome can 

be optimized by the appropriate manipulation of task variables. 

ERIC 



3 

A series of previous reviews have surveyed the research literature 
related to instructional psychology (Anderson, 1967; Gagne & Rohwer, 1969; 
and Glaser & Resnlck, 1972). While most of the Instruction relevant to 
school learning Involves classification, rule using, or problem solving, 
much of the previously reviewed research deals with recall. Frequently, 
Investigators have not made a distinction between various kinds of instructional 
outcomes and have tended to Investigate simple tasks and then generalize 
their findings to all learning situations. The purpose of this paper Is to 
provide an Interpretative essay and research review concentrating oh tasks 
which require these more complex behaviors. 

A difficult methodological task facing any researcher Is the adequate 
definition of his Independent and dependent variables. This problem Is con- 
founded when the variables are complicated and when researchers use as 
variables Involved procedures developed by the practitioner (e.g. , discovery 
and Inquiry). The first section of this paper will propose a two-dimensional 
classification system for determining a behavioral and content category. This 
system follows from Premise 4 above, and provides a framework for Interpreting 
existing research and a method for more adequately defining independent var- 
iables for future research. 

The second section proposes a taxonomy of task variables. Perhaps 
the most salient factor contributing to the paucity of research In this area Is 
the lack of any systematic identification of those variables that are manipu- 
lated by Instructional developers. The proposed taxonomy makes it possible 

er|c 
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to compare research studies related to Premise 5, and provides c method for 
defining variables in future research so that meaningful prescriptive propo- 
sitions can be stated and tested. 

The elements of both of the previously defined schemes are Illustrated 
with tasks and treatments used by researchers in this area. The third section 
describes a cross section of this research using the categories thus defined 
and suggests many propositions that have not yet been Investigated. A final 
section suggests implications of these schemes and resulting propositions 
for Instructional development. 

Two-Dlmenslonal Task Classification 

Existing schemes for classifying cognitive behavior differ In that each 
categorizes a different aspect of the Instruction-learning task. Bloom and his 
.co-workers (Bloom, Englehart, Faust, Hill & Krahwohl, 1956) based their 
categories on a combination of content and behavior, indicating that the 
system was a taxonomy of educational objectives • Gagne (1965, 1970) sep- 
arated categories on the basis of the conditions required to promote a given 
type of behavior. Merrill (1971a, 1971b) modified and extended the Gagne 
categories, but used as a basis for classification Intended overt behavior 
and the conditions under which it must be observed. 

A more complete taxonomy can be described If one recognizes that 
there are two somewhat Independent phenom.ena that can be classified. The 
first, task content ^ refers to those characteristics of a task Identifying it as 
primarily a paired associate, concept, principle (rule), or problem task. The 
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second, student behavior , refers to the overt acts a student performs and the 
conditions under which these acts must be observed before they can be termed 
discriminated recall, classification behavior, rule-using behavior, or higher- 
order rule -using behavior. 

The content dimension Is independent of the behavior dimension in 
that a task may be classified at one content level (e.g. , concept), but the 
student can still behave In relation to this task using any of several behavior 
levels (e.g. , discriminated recall or classification). Content and behavior 
are not completely independent, however. In that the content of a given task 
limits the level of behavior that can be demonstrated. For example. It Is not 
possible to demonstrate classification behavior in relation to a paired assoc- 
iate task. However, It is possible to respond using a lower level of behavior 
than that most appropriate for the content. 

Figure 1 illustrates this relationship of the content and behavior di- 
mensions of task classification. The boxes on the diagonal of Figure 1 are 
the categories previously Identified for the Gagne-MerrlU hierarchy. The 
Italicized words suggest new terminology that can refer to a task simultane- 
ously classified on both dimensions. The other boxes indicate combinations 
of task content and behavior and suggest some of the possible terms that can 
refer to such combinations . 

Insert Figure 1 About Here 
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Task Content 

Paired Associate Content , The content of a task is said to be paired 
associate when a set of symbols, objects, or events is associated on a one- 
to-one basis with another set of symbols, objects, or events. For a one-to- 
one association, the association must be made, not with just any Instance of 
the two sets, but with a particular member of one set paired with a particular 
member of another set. 

Some everyday paired associate tasks include the following examples: 
letters of the alphabet with letter names (symbol-to-symbol); notes on a mus- 
ical staff with note names (symbol-to-symbol); parts of a sewing machine 
with their names (object-to-symbol); inventions with inventors [objects-to- 




symbols {na:iaes) or objects-to-objects (pictures) | , sports records with the 



The task can be organized in list form or in paragraph form and still 
retain the critical characteristics of a paired associate task. One of the 
recent areas of substantial research activity is tfie investigation of "prose 
learning" by Rothkopf, Frase, and others, which was reviewed by Glaser and 
Resnick (1972). The "prose" experimental materials used in much of this 
research consisted of paired associate tasks organized in paragraph form as 
in the following sample (Frase, 1958a); 






''Jim is a pilot. He was bom in 1921. 
John is a policeman. He was born in 1930. 
Jack is a butcher. He Wr>s born in 1926. 
Jeff is an engineer. He was born in 1934. " 
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Concept Content . The content of a task consists of a concept when tt 
Includes a concept definition and a set of dlsciimlnably different symbols, 
objects, or events, which all have In common one or more attributes. A con- 
cept definition Is a list of relevant attributes. Attributes are those character- 
istics which determine class membership. Characteristics may be physical, 
functional, or relational. A concept Is Identified by a concept name — usually 
a symbol which refers to the members of the class individually vir collectively. 

Tennyson, WooUey, and Merrill (1972) used a real world concept of 
"trochaic meter. " The set of Instances Includes all passages of poetry with 
a stressed syllable followed by an unstressed syllable. The relevant attri- 
butes are themselves concepts, there are an Indefinitely large number of 
Instances, and there is a large and varied number of Irrelevant attributes 
that may or may not be present In every Instance (e.g. , number of lines, 
rhyme, subject, meaning, language, and punctuation). 

Principle Content . Much of the confusion surrounding Instruction and 
research on tasks above the concept level is caused by the lack of a satis- 
factory definition of principles. Gagne (1970) defined a principle as "... an 
Inferred capability that enables the individual to respond to a class of stimulus 
situations with a class of performances, the latter being predictably related to 
the former by a class of relations. " The formal definition of a rule proposed 
by Scandura (1966, 1968, 1970) Is: "... a set of stimulus properties (D) 
which determine responses, a set of response properties (R), and an operation 
(O) between them, such that each element in the first set Is associated with 

O 
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exactly one element In the second. . . " As Scandura points out, this Is the 
definition of a mathematical function and has the following form: R-= 0 
(D) where D Is the domain, 0 the function, and R the range. 

Extending Scandura's notion, a principle task consists of a stated 
rule In such a form that the stimulus set (D-set) and the response set (R-set) 
are Identified and the operation Is specified. It also consists of a set of 
problems. A problem is defined as the presentation of a member of the D-set 
with Instructions to the student to apply the operation thus producing one and 
only one member of the R-set. 

Guthrie (1967) taught several rules for solving cryptograms. The fol- 
lowing restatement of one of his rules Illustrates the above definition of a 
principle task: 



The problem set consists of all cryptograms. 

Problem Content . A higher order problem is one that invoxves the use 
of two or more rules, one of which determines the use of the other. Scandura 
has suggested in his more recent formulations (1968, 1970) that it is possible 
to have a rule for determining which operation (rule) to use in a given situation. 
If a principle is a statement that relates a D-set to an R-set by means of an 
operation (0); then a higher order principle Is a statement that Indicates an 
operation for t'>electlng one D-set from a set of D-sets, a corresponding R-set 



Each I Type ij cryptogram (D-set) can 
be changed Into a meaningful word (R-set) 
by exchanging the first ond the last letters 
(operation) . 




from a set of R-sets, and an appropriate operation from a set of operations. 

A problem task consists of such a higher order statement and a set of 

problems that can be solved by application of thia^ rule. The following example 

comes from Roughead and Scandura (1968). The set of D-sets consisted of 

all possible number series. The set of R-sets consisted of alJ possible sums 

of number series . The 0-set consisted of summing formulas for each type of 

number series. The higher order ^ule given is as follows: 

. . .formulas (0 set) for (set of D-sets) may be 

written as a product of an expression involving n 
n.e. , f (n)l and n itself, (higher order 0). . . . The 
required formula is simply zJ^= n^f (n) . n = number 
of terms in a given series. 

One of the specific rules that can be determined by application of the higher 

order mle is as follows: 

The sum (R-set) of a number series starting with 1 
and consisting of consecutive odd numbers (D-set) 
can be determined by squaring the number of terms (0). 

Student Behavior Related to Task Content 

Discriminated Recall . A student is responding with discriminated 
recall behavior when, given a member of the stimulus set in any order — a 
symbol, object, or event — he can immediately respond by providing the 
associated symbol, or indicating the associated object or event. The word 
recall Is used in the broad sense synonymous with memory. Recall Is some- 
times used to mean a constructed versus a recognized response. While there 
ire demonstrated differences between recognizing and constructing a response, 
both behaviors are included la the discriminated recall category. The first 
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critical condition for discriminated recall is that £ must be given a member 
of a set which he has previously been shown during learning. Second, the 
response must occur with a very short latency (immediately). Third, the 
student must be able to respond to the stimulus terms presented in any order; 
otherwise he may be exhibiting serial recall rather than discriminated recall. 
In addition, discriminated recall can be directly observed; that Is, no Infer- 
ence is necessary. Either a student remembers the associations within a 
limited latency period or he does not. Except to measure retention. It is 
only necessary for the student to make a single response to adequately dem- 
onstrate any given association In the set. 

Liscrimlnated Recall in Concept Principle and Problem Tasks . Embedded 
within every concept task are two paired associate tasks, definition and 
instance recall . First, the student can be asked to recognize or restate the 
definition or several definitions. Anderson (1972a) suggests that four types 
of test questions are possible In this situation: verbatim questions ^ state- 
ments taken word-for-word from the text; transformed verbatim questions ^ 
statements rearranged into various syntactical forms; paraphrase questions , 
statements in which synonyms are substituted in the original statements; and 
transformed paraphrase questions , where a paraphrased statement is rearranged 
into various syntactical forms. Anderson suggests that more meaningful pro- 
cessing Is required by paraphrased questions. While probably requiring at 
least a two-step memory process, the authors would still classify paraphrased 
definition recall as discriminated recalL 
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The second discrlmlAated recall behavior embedded in every concept 
task Is the recall of previously encountered instances. If a student is pre- 
sented a set of in;i 'nces and told they are members of a particular class, 
and then, in a test situation. Is asked to recognize these same class members, 
the behavior required is not classification, but discriminated instance recalL 
In practical situations, students are often asked to remember instances of 
a concept from their past experience or to bring examples from home. In most 
cases, the instances thus generated are those that were presented during 
instruction or that closely resemble those presented during instruction and 
that require a form of discriminated instance recall. 

A student can be asked to demonstrate discriminated recall in a prin- 
ciple task as well as In a concept task. In addition to definition and instance 
recall Indicated for concept tasks, he can be asked to recall or recognize the 
stated rule. Whether recognized, reproduced word-for-word, or paraphrased, 
remembering a stated rule is primarily discriminated recall. 

If the operation has already been applied to a particular member of 
the D~set and this application shown to the student, then asking him to 
resolve the problem Ir a solution-recall situation, not a rule-using situation. 

For higher order problem tasks, there are two more recall possibilities. 
S can be asked to recall the statement of the higher order rule or the appli- 
cation of the higher order rule to a particular D-set. 

Definition and rule recall are the most frequently used testing pro- 
cedures in most Instructional settings even when classification or rule-using 
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behavior would provide a better situation for Inferring comprehension. Clearly 
Identifying the separate content and behavior components In these situations 
should facilitate more adequate evaluation. 

Classification Behavior . S_ Is demonstrating classification behavior 
when, given an unencountered Instance (exemplar or nonexemplar) of a par- 
ticular class, he is able to indicate class membership. can Indicate class 
membership by giving the class name or pointing to the exemplar when given 
an exemplar-nonexemplar pair. The critical conditions under which classi- 
fication behavior must be observed Include the following: first, the instance 
must be unencountered; that is, it must not have been previously Identified 
as an exemplar or nonexemplar of the class being taught. Second, it Is not 
possible or practical to observe S^*s response to every possible instance 
since real world concepts consist of indefinitely large classes. Therefore, 
when his classification of one Instance Is observed, we must raake inferences 
about his ability to correctly classify yet unencountered instances. In this 
sense, any observation of classification behavior must take place in a transfer 
situation. Third, since we are making Inferences about S^'s ability to correctly 
classify yet unencountered Instances, the adequacy of this inference depends 
on how well the sample instances represent the range of instances included 
in the class. Fourth, since we are making Inferences from a sample, it Is 
necessary for reliable observation to observe S's classification of several 
Instances. Up to a point, the more Instances used for observation, the 
more reliable the inferences. 
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S can also demonstrate his understanding of a particular class, if, 
during presentation of Instances the relevant attributes are not named, but 
later he Is asked to Identify them after he has been shown a number of exemplars 
and nonexemplars . This technique of measurement is the most frequently 
used procedure for laboratory Investigations of concept learning (see Clark, 
1971), but has not been used widely in more practical situations. 

Anderson's (1972a) fifth and sixth kind of questions for measuring 
comprehension deal directly with classification measurement. His fifth type 
Is "questions formed by substituting particular for general terms. " The 
name and definition of a concept are general terms while the instances are 
particular terms. This Is equivalent to presenting new Instances to the 
student and having him classify them. The final type of question suggested ■ 
-by Anderson consists of "questions formed by substituting general terms for 
specific terms. " This Is equivalent to deriving the definition from Instances 
which have been presented. 

Classification in Principle or Problem Tasks . Even though the content 
of the tasks Is principles, S^may still be requif^d to demonstrate classification 
behavior rather than application of the operation. Classification behavior 
can be demonstrated by having S Indicate class membership for Instances of 
either the stimulus set (D-set) or response set (R-set). 

When the content of a task Is higher order problems , S may also be 
asked to classify an entire D-set or an entire R-set as members of the greater 
sets included as part of the higher order problem situation under consideration. 
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In addition, he can classify Instances of the operation. 

Principle or problem classification is frequently neglected in instruc- 
tional evaluation. Students are often able to use a given operation once a 
problem has been identified as a member of the D-set to which the operation 
applies but they are unable to determine when to use a given operation. 
Identifying the classification components of principle tasks should facilitate 
more adequate evaluation. 

Rule-Using Behavior . S is demonstrating rule-using behavior if, when 

"— ♦ 

given an unencountered instance of a particular D-set, he can apply the oper- 
ation (0) and produce the corresponding member of the R-set. S can demon- 
strate this behavior by writing or pointing to the appropriate member of the 
R-set, or he can be given a particular member of the R-set and the operation 
and asked to which member of the D-set the operation should be applied. 
Crhere are, however, some noncommuta tive rules for which this procedure 
would be Inappropriate.) Unless S is told that the particular problem presented 
is a member of the appropriate D-set, he must first perform a classification 
task by correctly identifying the class membership of the instance. The 
critical conditions under which rules must be observed for adequate Inference 
are similar to concepts and require unencountered problems. Inference from 
a transfer situation, and adequate problem sampling. 

Anderson (]972b) gives a good example of rule-using behavior applied 
to ^ principle task, using the following principle: "Intermittent reinforcement 
causes high resistance to extinction. " Ss were presented this principle In a 
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paragraph that further defined "Intermittent reinforcement" and "resistance to 
e^rtlnctlon, " and that presented an example of the application of the principle. 
The test consisted of presenting' a series of multlple--cholce questions putting 
a particular organism in a given situation (D-set) and Indicating a particular 
reinforcement schedule (0). The alternatives were various patterns of po- 
tential resulting response (R-set). An example is as follows: 

"A hungry pigeon in an experiment is given a pellet 
of food for some, but not all, pecks on an Illuminated 
disc. When food Is no longer given, the pigeon will: 

a. squawk and flap its wings. 

b. begin to peck the walls and floor of the cage. 

c. begin to peck the disc more frequently. 

d. maintain pecking the disc. 

e. soon stop pecking the disc. " 

The sample of items presented varied the organisms, situations, and the 
patterns of reinforcement. Compared to a control group who read a control 
passage, the experimental S_s oerformed better. The performance was best 
on items Identical to the sample given in the passage (discriminated recall), 
next best on very similar items, and worse on different items (rule using) . 

As with classification behavior. It is possible to infer comprehension 
of a principle under an inductive situation where is first presented a number 
of solved problem Instances (instances that Illustrate the application of 0 
to particular members of the D-set) and then asked to indicate the appropriate 
operation. If during the process of presenting solved instances, S is told 
the* rule, he may merely demonstrate discriminated recall. Even after he has 
discovered the rule following such a procedure, it Is desirable to test him in 
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unen countered problem situations. 

Rule Using In Problem Tasks. When the content consists of higher- 
level problems, can be asked to apply one of the operations constituting 
the 0-set to Its D-set. When the rule Is Identified for the student rather 
than asking him to generate the rule by application of the higher order rule, 
the resulting behavior is rule-using rather than higher order rule-using. 

Higher Order Rule-Using Behavior . S Is demonstrating higher order 
rule-using behavior when, given an unencountered D-set, he can apply the 
higher order rule and produce the operation to be applied to each member of 
that D-set to produce appropriate members of the R-set. To observe higher 
order rule-using behavior, S can be given an R-set and operation and asked to 
determine the appropriate D-set. (As with rules, this is not appropriate in 
all cases.) The D-set must be an unencountered set, and the application of 
the higher order rule must be to a new situation. Constraints of adequate 
sampling and reliability also apply. 

Taxonomy of Task Variables 

Research-based prescriptions for the manipulation of task variables 
are scant in spite of the central position Premise 5 has for most of the current 
work In Instructional development. Perhaps one reason for this limited activity 
Is that a systematic scheme for Identifying which task variables are most 
likely to effect Instruction has not previously been developed. This paper 
proposes such a classification scheme. 

Table 1 summarizes the taxonomy. Three major qualitative categories 
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are proposed — presentation form, interdisplay relationships ^ and mathemagenic 
Information. Each of these categories is subdivided into several variables 
and each variable Is further subdivided into two values representing ends of 
a set of qualitative contlnua. Three quantitative parameters are also proposed 
— sequence, quantity, and pace. Each parameter consists of several quant- 
Itive dimensions which can be applied to any of the qualitative variables. 
The combinations of the quantitative parameter values and qualitative cat- 
egories suggest many possible treatment conditions. 

Insert Table 1 About Here 

The variables Identified In Table 1 are independent of the behavioral 
level of a given task or of a given test situation. For each level of behavior 
(i.e. / classification/ rule-using, higher order rule-using) , it is possible to 
define an expository or an Inquisltory presentation that uses either generalities 
or Instances; It is possible to define generality scope, instance scope, at- 
tribute matching, and Instance probability; and It Is possible to define correct 
answer, attribute isolation, or algorithms. 
Presentation Form 

Presentation form deals with the questions: What is presented (gen- 
erality or instance)? And how is It presented (expository or inquisltory)? 
Presentation mode Indicates whether or not a response Is solicited from the 
student. If the display presents information, it Is expository; If It asks a 
question, It Is Inqulsitory. Presentation content refers to v/hether the 

O 
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presentation consists of a general statement (generality) or a specific example 
of a more general class (Instance). If the Information Is an abstraction that 
refers to the whole class, or relates several classes of specific Instances / 
then It Is a generality. In concept Instruction, the generality is the definition 
of the concept. In rule using the generality Is the statement of the principle 
or rule being taught. 

Instances are specific examples or members of the class under con-- 
sideration. In the case of the concept, the Instances are specific members 
grouped by the concept label. In a principle task, the Instances are those 
specific problems that consist of a specific Instance from the stimulus class 
to which the operation has been or can be applied to produce a specific 
instance of the response class. In problem situations, the Instances are those 
sets of problems for which an operation can be determined by use of a higher 
order rule. A negative instance Is any specific example that is not a member 
of the class or classes under consideration. For concepts, Instructlonally 
relevant negative Instances are potentially confusing examples of similar 
concepts. For principles and problems, negative Instances consist of in- 
appropriate applications of the operation or higher order rule. 

Any particular instance of a complex cognitive instructional presen- 
tation must always feature pome combination of presentation mode and content. 
Combining the qualitative values into a two-way table produces the following 
presentations: expository-generality (EG), expository-instance (Eeg); Inquls- 
itory-generallty (IG), and inqulsltory-instance (leg). In an expository- 
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generality (EG) presentation, S is presented definitions or rules and directed 
to study or read these generalities. In an expository-Instance (Eeg) presen- 
tation, S Is presented exemplars or non-^exemplars of a given concept along 
with some indication of appropriate class membership or a sample of the 
application of a rule to a particular problem, Th's presentation may be In the 
form of questions as long as the answer is given at the same time. In an 
inqulsltory-generallty (IG) presentation, the student Is asked to reproduce 
or deduce the definition or rule. If this presentation follows an expository-- 
generality presentation, then It requires discriminated recall, not classifi- 
cation, rule using, or higher order rule using. However, If this presentation 
follows a series of expository-Instance^ presentations, and S_is asked to 
deduce the rule from these previous presentations, then it does require class- 
ification behavior above. In an Inqulslrory-lnstance (teg) presentation, £ 
Is presented an exemplar or nonexemplar of a concept and asked to indicate 
class membership; or he Is given a problem and asked to apply the rule. 

Simple examples of these combinations are not easy to find, since 
most strategies are really some aggregate of two or more. In most of the 
studies cited for illustration, a comparison of presentation form variables 
was not the primary research question. Since the task variables are inde- 
pendent of the type of complex cognitive outcome, one should be able to 
identify an Instance of each of the strategies as It applies to concept/ class- 
ification, principle/rule using, and problem/higher order rule-uslrig tasks. 
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Concept: Eq-Eeg or leg. Tennyson, WooUey, and Merrill (1972) 

taught the concept "trochaic meter" using a combination procedure consisting 

of an expository-generality (EG) followed by an expository-Instance (Eeg) 

presentation. The EG presentation consisted of one page containing the 

following definition: 

Part of the rhythm of a poem Is determined by 
the time between stresses occupied with un-- 
stressed syllables or pauses. Denoting the 
stress patterns is to establish the meter. One 
of the major meter scansions Is named trochee 
and consists of a stressed syllable followed 
by an unstressed syllable (marked thusly:). . . 

The expository-generality presentation was followed by a series of 

four expository-Instance presentations, each consisting of a page containing 

four short passages of poetry: two exemplars Illustrating trochaic meter and 

two nonexemplars . The Instances were 'clearly labeled as "example" and 

"not an example. " A sample page Is as follows: 



—Example 



matched^ 



Out of childhood Into manhood 

Now had grown my Hiawatha (Longfellow) 



Come to the crag where the beacon Is blazing 
Come with the buckler, the lance, and the bow 

(Scott) 

Pansles, lilies, kingcups, daisies. (Wadsworth) 



—Not an Example 
divergent 

Example 

- matched 

_Not an Example Motherly, Fatherly, Sisterly, Brotherly! (Unknown) 

WooUey (1971) replicated this study but modified the Instance pre- 
sentation so that rather than being told which were the exemplars and which 
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were the exemplars and which were nonexemplars , S was required to Indicate 
his choice after which he was given the correct answer. 

Concept: EG-IG , As part of a concept study, Johnson and Stratfcon 
(1966) included an expository-generality (EG) or "definition'* treatment in 
which each ^ was shown a page containing four definitions and asked to re- 
write the definition in his own words. The inquisitory generality (IG) test 
was administered nine days later and consisted of a page containing four 
words which ^ was asked to define in writing. Because this test does no^ 
meet the conditions necessary for classification behavior, it is definition 
recall* 

Concept: Eeg or leg-IG. Laboratory studies of concept learning 
typically present a set of instances — exemplars and nonexemplars — in either 
an expository or inquisitory mode. When he can, S is asked to indicate the 
relevant attributes (inquisitory-generality) . Clark (1971) reviewed 250 such 
studies . 

Rule: Eg-Eeg-Ieg. In a task designed to teach the rule for winning a 
NIM game, Scandura, Woodward, and Lee (1967) used three types of presen- 
tation: an expository-generality, an expository-instance, and an inquisitory- 
Instance. A NIM game involves two players. The first chooses a number 
within a limited series (e.g., 1-6); the second player names another number, 
also within the set; the first player then names another number. This process 
continues until the cumulative sum reaches or surpasses a given amount. The 
player who names the final number required to reach the predetermined sum 
wins the game . 
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The expository-generality presentation consisted of a rule for winning 
the game whenever you are allowed to make the first choice , The following 
page was an expository-Instance presentation which consisted of a sample 
game with the responses of both players Indicated. This sample game showed 
how the rule was applied to a (6, 31) game where the selection set was the 
digits 1-6 and the final sum was 31. The third presentation w^s an Inquls- 
Itory-lnstance presentation In which S was asked to complete an additional 
example of a (6, 31) NIM game. 

Rule: Eeg-IG . An Inqulsltory-generallty (IG) presentation maybe 
described using the m.aterials previously defined. If the rule for winning a 
NIM game as previously described by Scandura, Woodward, and Lee (1967) 
were to be deduced from an expository-instance (Eeg) presentation consisting 
of a series of differently solved NIM games, then if S can state the rules for 
winning (IG) his behavior would require rule-using. 

Rule: leg . Guthrie (1967) used a pure inquisitory-instance (leg) pro- 
cedure involving a rule for solving a particular cryptogram (words formed by 
scrambling letters). Without telling S the rule, he presented a series of 
cryptograms, each scrambled according to one rule until S was able to cor- 
rectly say eight successive words. S was never required to verbalize the rule. 
Interdlsplay Relationships 

The second major class of variables Indicated in Table 1 is inter- 
dlsplay relationships, A display is defined as that material constituting a 
single presentation which may take any of the four forms previously identified — 
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expository-generality, expository-Instance, Inqulsltory-generallty, or Inquls- 
Itory-lnstance. 

Interdlsplay relationships refers to similarities and differences that relate 
one display or its elements to another display or Its elemer*3. The variables 
described deal with relation of generalities to generalities, generalities to 
Instances, instances to instances, and instances to the ability of a given 
S_ population . 

Generality Scope . Generality scope relates generalities to generalities. 
In complex cognitive behavior, there are at least two types of generalities: 
concept definitions and rules, A concept definition Ls basically a list of 
relevant attributes used to indicate class membership* This list can take 
several forms: conjunctive, disjunctive, relational, and biconditional (Clark, 
1971). 

One definition is more restricted than another when the set of objects 

or events referenced by the restricted definition are a subset of the objects or 

events referenced by the more general definition. 'The structure of language Is 

such that almost all concepts are subsets of more general concepts while at 

the same time, consisting of more restricted concepts. A general concept 

definition is that of "metered foot. " 

Meter Involves a measured, patterned arrangement 
of syllables according to stress and length. A group 
of syllables which consist of the basic unit of meter 
li: called the foot. 

A restricted definition would define a particular kind of metered foot, e.g. , 
trochee . 
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Trochaic meter Involves a measured, patterned 
arrangement of syllables where the first syllable 
Is stressed and the second Is unstressed. Each 
set of a stressed followed by an unstressed syl- 
lable Is a trochee foot. 

A rule consists of two sets (concepts), a stimulus set or domain (D-set), 
and a response set or range (R-set). The rule relates these two sets by means 
of an operation such that applying the operation to a member of the stimulus 
set produced one and only one member of the response set (Scandura, 1966, 
1968). When defined in this way, rules can be easily ordered as to qenerality. 
One rule Is more general than another if it includes all of the stimulus elements 
and their resultant response elements plus additional stimulus response pairs 
of its own (Scandura, Woodward, & Lee, 1967). 

In a previously cited study, Scandura, Woodward, and Lee (1969) 

Investigated extra scope transfer in a rule-using task Involving the NIM game. 

The specific winning rule which applied only to (6, 31) games was as follows: 

"In order to win the game, you should make three 
your first selection. Then you should make se- 
lections so that the sums corresponding to your 
selection differ by 7. 

The more general rule which applies to all (n, m) games was as 

follows : 

"In order to win the game, the appropriate first 
selection is determined by adding one to the largest 
number in the set from which the selection must 
come and dividing the desired sum by the result. 
The remainder of this division is precisely the 
selection that should be made first. Then, you 
should make selections so that che sums correspond- 
ing to your selections differ by ope greater than 



ERIC 



25 

the largest number In the set from which the 
selections must come/* 

As we observe, the specific rule Is restricted to a single type of 
NIM game, while the general rule refers to all (6, 31) games plus any other 
NIM games of the form (n, m). 

Instance scope . Instance scope relates Instances to generalities. 
When Instances possess the attributes listed by the definition, they are said 
to be a wlthln-scope exemplar. If the Instance possesses attributes not 
listed In the definition, then the Instance Is extra scope. By definition, 
nonexemplars are extia-scope Instances. 

Both of the following passages are examples of metered verse. The 
foot Is underlined. " 

Out of Childhood Into manhood 
The God of love my shepherd Is , 
In relationship to the definition of metered foot given above, both are wlthln- 
scope Instances. In relationship to the restricted definition of trochaic meter, 
the first is a withln-scope Instance, but the second is an extra-scope In- 
stance, since it Involves Iambic meter (first syllable unstressed with second 
syllable stressed). 

An Instance of a rule Is a problem that consists of a stimulus situation 
to which an operation can be applied to produce a member of the response set. 
Scandura Indicated that concepts were special cases of rule-using where the 
operation was a mapping operation and there was only one member in the 
response set (Scandura, (1966c, 1968). In the simplest case, an extra-scope 
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problem Is one which does not belong to the stimulus set referenced by the 
rule, but does belong to a more general set that can be encompassed by a more 
geueial rule. In the case of higher order rules, where there are a class of 
operations involved, an extra-scope instance is one that requires a variation 
of the operation included in the statement of the rule. In other words, the 
extra-scope Instance might be within the scope of a higher order rule, but 
Is extra scope for the more restricted rule that has been stated. 

In the previously cited study of Guthrie (1967), S^s were tested using 
both within - and Q<te" scope Instances. Given two rules for solving crypt- 
ograms, one of which was , "Exchange the first and last letters. . . , " each 
was tested on within-scope instances which could be unscrambled using one of 
the two rules he had learned. Second, he was asked to solve "near transfer" 
items, scrambled according to the same type of rule, i.e. , transpositional, 
but where different letters were transposed, e.g. , "Reverse the order of the 
first half and last half oF the letters. " Next, he was given "remote transfer" 
items, requiring application of a different type of-rule, i.e. , substitutional, 
e.g., "Replace the numbers with the correct vowel (a, e, I, o, u equals 
1, 2, 3, 4, 5)." Both of the latter "transfer" tasks were extra scope instances. 

Attribute matching ^ Attribute matching relates instances to other in- 
stances. Class membership of a given instance of a concept Is determined 
by relevant attributes. All other attributes are said to be Irrelevant. Two 
Instancef? are matched when their irrelevant attributes are as similar as pos- 
sible and divergent when the Irrelevant attributes are as different as possible 
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(Tennyson and Woolley, 1972). Exemplars may be matched or divergent 
with other exemplars or with nonexemplars . Obviously, attribute matching 
Is a matter of degree. 

Attribute matching was one of the variables manipulated in the pre- 
viously cited study by Tennyson, WooUey, and Merrill (1972). The four 
Instances on each display consisted of tv/o exemplars of trochaic meter, each 
matched to a nonexemplar and divergent from each other. The previously 
cited display from this study illustrates the matched and divergent relation- 
ships. The irrelevant attributes Included rhyme, number of lines, and subject 
matter. The first pair are matched In number of nonrhyming lines and basic 
subject matter. The second pair both consist of four similar words and one 
line. The difference between the exemplar and the nonexemplar In each pair 
.Is the relevant attribute, i.e. , type of meter. The two examples are very 
different (divergent) from each other in subject matter, number of lines, and 
the fact that one tells a story (or part of one) and the other Is merely a set 
of similar words . 

Attribute matching in rule using tasks is much more complex than for 
classification tasks. Attribute' matching can be defined for both the stimulus 
set and the response set. Traub (1966), without so identifying. Introduced 
a divergent relationship between members of the stimulus set which he called 
problem heterogeneity. His ta'^'k was graphical Integer addition using a number 
line. The Irrelevant attributes consisted of such things as the magnitude of 
of the digits Involved, the segment of the number line contained in the problem, 
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whether the segmenc ccntairHi a zero point and the direction the arrow was to 
be drawn. 

Thatcher (1972) in an extension of the Traub study, introduced, in 
addition to 1he divergent relationship between members of the stimulus set^ a 
matched relationship between exemplars and nonexemplars of the response r^et. 
During the presentation, he paired incorrectly solved problems with correctly 
solved problems • The incorrectly solved problem was matched to the correctly 
solved problem in the line segment used and the number of numbers involved. 

Guthrie's (1967) cryptogram task provides a good illustration of the three 
levels of attribt te matching possible within a problem-solving task. First, 
instances within the stimulus set (cryptograms to be solved) can be matched 
or divergent on such dimensions as the number of letters, syllables, and type 
of word (noun, adverb, and verb) . Members of the response set can be 
matched or divergent on such attributes as number of letters substituted or 
transformed, or the number of different steps required to unscramble. In both 
of these sets, these relationships can be between'instances, i.e. , cryptograms 
with cryptograms in the stimulus set; correct solutions with other correct 
solutions in the response set; or between instances and noninstances; i.e. , 
cryptograms with noncryptogramg; correct responses with incorrect responses. 
In addition to matching within and without the stimulus and response sets, 
one can describe matching relationships between operations. These relation- 
ships can also be operations matched or divergent from other operations a operations 
matched or divergent with Incorrect or inappropriate operations, 
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Instance difficulty ^ Given a set of objects or events and the directions 
to Identify class membership, students will almost always find some members 
of the set more obvious than others. Inferences from concept research would 
Indicate that this Is a function of the number of relevant attributes defining 
a given concept (cf. Clark, 1971, statement number 4, twelve studies support 
tht^ finding), the number of irrelevant attributes present for a given Instance 
of a concept (cf. Clark, 1971, statement number 11, forty studies support this 
finding), and variances in the difference between relevant and irrelevant attributes 
(cf. Clark, 1971, three studies support this finding). An o^jerational procedure 
for assessing the relative difficulties of the Instances to be used in a given 
task was defined by Tennyson and Woolley (1972) and elaborated by Tennyson 
and Boutwell (1972). The procedure Involves an expository presentation of 
a definition followed by an Inqulsltory presentation of a large sample of 
instances, both exemplars and nonexemplars, to a sample of students rep- 
resentative of the target population to be taught. The percentage of the 
sample correctly identifying a given instance provides an empirical measure 
of the ease with which a given instance will be recognized. Applying this 
procedure to the concept trochaic meter, using college Ss yielded distribu- 
tions which approximate the normal curve (Merrill and Tennyson, 1972a, 
1972b; Tennyson, 1972). 

In rule using, the variable, Instance difficulty, must be defined for 
both the stimulus set and the response set. Assessing the difficulty of the 
stimulus set would be similar to the instance probability procedure employed 
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for concept tasks. The difficulty of response set Instances most likely 
depends on similar parameters to that of a concept set; however, in this case 
some of the irrelevant attributes also consist of the number of logical error 
possibilities, and the complexity of the response. Perhaps the probability 
of a given response set instance can also be assessed by an empirical pro- 
cedure, but such a procedure has not been employed as far as the reviewers 
have been able to determine. 

Higher order rules also involve a set of operations. Just as with an 
ordinary concept set, this set will also consist of some operations which are 
more complex, contain more irrelevant attributes, and are more difficult to 
discriminate, than are other operations m a given set. This introduces the 
possibility of an oporations instance probability. This variable will no doubt 
prove to be an important variable for the study of problem solving. The re- 
viewers were unable to identify any examples where operations Instance 

probability was applied to problem- solving tasks. 

2 

Mathemagenic Information 

Mathemagenic Information Is so called because it is additional or 
augmenting information provided to facilitate learning. Mathemagenic infor- 
mation Is always provided in relation to instances and will only be present 
when one uses an expository-Instance or the inqutsltory- instance presentation. 
There are at least three types of mathemagenic Information: correct answer, 
attribute Isolation, and algorithms. 

Proinptlng and feedback are two classes of mathemagenic Information 
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variables. Prompting has been called hints, cues, and clues. Feedback has 
been called reinforcement (probably Incorrectly, cf. Anderson, 1967), con- 
firmation, or knowledge of results. For this taxonomy, they are lumped 
together because they consist of the same information, given at different 
points in an Instructional sequence, Mathemagenic information contained in 
an expository- Instance presentation which precedes an Inquisltory- Instance 
presentation Is presented before S is asked to respond and is a form of 
prompting. Mathemagenic information which is presented following en in- 
quisltory- instance presentation, afte the student has responded, Is always 
a form of feedback. 

Correct Answer . The simplest form of mathemagenic Information con- 
sists of providing with the correct response for a given instance in an 
expository presentation (prompting) or providing him with the response he 
should have made following an inquisltory presentation (feedback) . In some 
feedback situations, rather than being told the correct answer, S is merely 
told he Is "right" or "wrong." 

Correct answer prompting In concept learning situations is Illustrated 
In the previously cited study by Tennyson, Woolley, and Merrill (1972). 
After receiving a definition, S was presented examples and nonexamples of 
the concept trochaic meter. Each verse was accompanied by the word, 
"example," or "not an example." 

Correct answer feedback is illustrated in the same concept task In the 
previously cited study by Woolley (19 71) . Woolley did not label the verses of 
O oetTY, but asked S, to Indicate the example. After S had responded, then he 
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was given feedback consisting of the verse labeled "example" or "not an 
example . " 

Part of the expository-Instance treatment previously described for 
the Scandura, Woodward, and Lee (1967) study consisted of a correct answer 
prompt for a rule using task. After an e^, v^osltory presentation of the rule, 
S was shown a completed example of a NIM game. This Is essentially a 
oroblem with the correct answers given. 

This same study and treatment can be used to Illustrate a correct 
answer feedback procedure for the rule using task. After studying the com- 
pleted game, S was given a different (6, 31) NIM game and asked to complete 
the responses. After he had finished, he turned the page and found the game 
worked for him — or, more precisely, found the correct answers given In a 
feedback position. 

Isolation of attributes . When some procedure focuses attention on 
the relevant attributes of a given stimulus situation, thus facilitating dis- 
crimination^ such a procedure Isolates attributes. Attributes can be Isolated 
prior to or after a student responds by such devices as underlining, color 
emphasis, exploded drawings or pictures, Italics, arrows, or boxes. 

While prompting has been Investigated with memory tasks, very little 
has been done In teaching concepts. Merrill and Tennyson (1972) Investi- 
gated a prompted expository presentation of the trochaic meter task which 
employed an attribute isolation technique. They defined trochaic meter and 
the use of stress symbols and then marked the rhythm pattern In each verse 
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(/ for stressed, for unstressed). A prompted verse appeared as follows: 

/ ^ / w / ^ 

Out of childhood Into manhood 

Now has grown my Hiawatha. 
Without Identifying It as such, Roughead and Scandura (1968) used 
an attribute isolation prompting technique for teaching a rule using task* The 
task was to "discover" the general formula for summing number series. The 
presentation consisted of three series and their respective summing formulas. 
The problems were presented In tabular form which Isolated the term numbers, 
term values, and cumulative sums. All of the attributes are present or can be 
determined from the unprompted presentation, but are more obvious In Isolated 
form. If, In this task, S_ had been given the series and asked to find the 
formula first, then presenting the tabular presentation would constitute feed- 
back. 

3 

Algorithms . An algorithm Is a rule for analyzing a given instance in 
order to Identify its class membership or to set It up for applying the operation 
(search strategy) . It may also be a rule for synthesizing an answer or product 
by applying an operation (production strategy). A search strategy In a concept 
task Is a rule for searching for and identifying the relevant attributes. In a 
rule using task, this search strategy is extended to rules for identifying 
whether or not the term is one to which a given operation applies or rules for 
applying the operation to the stimulus term. Production strategies are rules 
for producing the response term or a product. Since algorithms are themselves 
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generalities (rules). It Is accurate to say that they are rules for solving a 
given problem. In the trochaic meter task previously described, an algorithm 
(search strategy) for Identifying relevant attributes might be as follows: 

1. Write or Imagine the line broken Into syllables as follows: 
"out of child hood In to man hood . . . " 

2. Read the line aloud listening for stressed syllables. 

3. In trochaic meter, the odd numbered syllables are stressed and 
the even unstressed, etc. , for other patterns of meter. 

Scandura and some of his students (1966) employed an algorithm 

prompting technique In teaching a rule-using task. The stimulus set was 4- 

tuple sets of integers, e.g., (4, 8, 9, 3); the response set consisted of an 

integer which could be derived uniquely from three numbers In the set by 

using two arithmetic operations, e.g. , add the first and second integers in 

the set and subtract the fourth. The task for the student was to "discover" 

the operation which applied to a given set of items. Given this information, 

a general algorithm can be formulated: 

After indicating that there is a rule . . . 

To help you discover this procedure as >apidly 
as possible, you shouJd try to determine the 
three specific positions in the 4 - tuple and an 
arithmetic rule involving two operations (e.g. , 
add and divide) which combines the numbers In 
these positions to yield the corresponding number. 

In a sense, providing an algorithm for any task makes It a rule-learn: .g task 

by providing instruction within Instruction. All previous variables applying 
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to mle learning can also be applied to providing an algorithm as a prompt or 
as feedback. 

Merrill (1965, 1970) provided algorithms in a feedback position in an 
imaginary scient task. This treatment was labeled "specific review" and 
consisted of a step-by-step solution of the problem which the student had 
previously tried to solve. 

Variable Parameters - Sequence, Quantity, Pace . Each of the quantitative 
variables listed in Table 1 can be applied to any of the qualitative variables 
previously described. The next few paragraphs will define a few possible 
combinations to clarify the meaning of the quantitative parameters • 

S equence . Sequence deals with what should be presented first (order) ^ 
how reoccuring procedures should be patterned (schedule)/ and whether dif- 
ferent kinds of events should be presented as successive or simultaneous 
displays. 

Sequence Order . Prompting and feedback are one combination of order and 
the mathema^nfc Information qualitative variables already discussed. Most 
of the treatments described to Illustrate mode and conLent of presentation 
were also combination treatments ordered In a variety of ways: Eg-Eeg or 
leg (Tennyson, WooUey, and Merrill, 1972; WooUey, 1971); EG-IG (Johnson 
and Stratton, 1966); Eeg-Ig or leg-IG for an Inductive concept presentation 
(Clark, 1971); and EG-Eeg-Ieg In a rule Instruction task (Scandura, Woodward, 
and Lee, 1967). The primary variable investigated in each of these studies, 
however, was no order crossed with presentation form. 
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Sequence Schedule . Schedule refers to the pattern of receiving 
qualitative variables. One example deals with whether an expository gen- 
erality (EG) followed by Inqulsltory-lnstance (leg) presentation which includes 
several concepts or rules, should be presented Eg Eg Eg-Ieg leg leg or whether 
an Eg Ieg--EG leg - EG leg schedule would be better. Another schedule question 
deals with Interdisplay relationships. For example, Tennyson, WooUey and 
Merrill (1972) described three instance probability schedules In an expository- 
Instance presentation of instances of trochaic meter. Each treatment Involved 
four displays, each containing four instances. One probability sequence was 
hlgh-medlum-medlum-low; a second was high-hlgh-high-hlgh; a third sequence 
was low-low-low-low. This study did not provide a direct comparison of these 
variables because each was confounded with attribute matching which also 
varied across treatments. Feedback and prompting schedules are also appli- 
cations of this quantitative variable. 

Sequence Simultaneous versus sequential presentation . Thi3 variable 
Is In one sense a special case of scheduling, but^sufflclently Important and 
different that It has been separated for discussion,. Questions which result 
from applying this quantitative dimension to the qualitative variables already 
described, are as follows: Is a display consisting of both an expository- 
generality and an Inqulsltory-lnstance presentation, better than presenting the 
Inqulsltory-instance presentation following the expository-generality presen- 
tation? Similar questions could be asked about the other possible combinations 
or about interdisplay relationships, e.g.. In attribute matching, should matched 
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Instances be presented simultaneously or sequentially? Other simultaneous 
versus sequential questions could deal with various combinations of mathema- 
genic Information, and various combinations of mathemagenic information with 
interdisplay relationships. 

Quantity , The question of how many or how much can be applied to 
almost every value of each of the qualitative variables identified. It Is 
likely that many such questions are specific to individual students; never- 
theless, there are limits which probably apply to most students. 

A second question related to quantity is the relative proportion of 
the components of various combinations. What should be the ratio of instances 
to generalities; the ratio of exemplars to nonexemplars; the ratio of high to 
low probability instances; or the ratio of prompting to feedback? 

Pace . In the realm of complex cognitive behavior, very little has 
been done to investigate thi? parameter. The basic question deals with pro- 
grammed paced versus self-paced presentations. This is usually applied to 
the overall presentation, but it is possible to Introduce paced segments into 
a primarily learner paced presentation. Other decisions need to be made about 
whether mathemagenic prompt information should be limited in its availablility? Or 
feedback? Do some paced presentations facilitate learning? 

As soon as pacing becomes a factor, then Interval time becomes 
critical. The intervals may be very short, such as a few seconds between 
successive displays, or long, such as several days or weeks. Delay is a 
critical part of the definition of retention and, hence, whenever retention is 
6 
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examined as a dependent variable, one must be concerned with the retention 
interval . 

Experimental Research on Task Variables Promoting Higher Cognitive Behavior , 

The following paragraphs review some of the best research on task 
variables done to date using concept, principle and problem tasks. While It 
would be presumptuous to say this review is exhaustive, it is nevertheless 
true that there are very few continuing systematic research efforts in this 
area. Several criteria were used In selecting studie? for inclusion. First, 
they must involve at least classification beha\n::)r of above. If a task involved 
concept, principle or problem content but the behavior required was discrim- 
inated recall, then the study was not included. For example, Kulhavy and 
Anderson (1972) reviewed a series of studies on delay of retention with 
multiple choice tests. In every case, the dependent variable was performance 
on a second administration of the test after the correct answers had been given 
following the first administration. Even though the tasks were classed as 
"meaningful verbal materials," sometimes involving concepts and principles, 
the behavior required was instance recall. Most of the investigations of 
prose learning (See Glaser and Resnlck, 1972 for review) are not Included, 
even though the content sometimes Involves concepts and principles because 
the behavior required is usually recall. 

A second criterion was fidelity to classroom or "real world" content. 
Clark (1971) reviewed more than 250 concept studies. While the findings of 
these studies have relevance for task variables, most were highly structured 
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laboratory tasks. As Indicated In Clark's (1971) paper, real world concepts 
often consist of an Indefinitely large number of possible Instances; labora- 
tory concepts are usually limited to a small number of Instances. Real world 
Instances are frequently abstract and become more so as a student goes from 
grade to grade; laboratory concepts are usually concrete physical objects. 
The attributes of real world concepts are themselves properties (concepts) 
and, hence, each such property can be viewed along several continuous di- 
mensions; the attributes of most laboratory concepts are dimensions which have 
two or more discrete values. The number of attributes, especially irrelevant 
attributes, and t.*alr possible combinations Is Indefinitely large for real world 
concepts; the number of dimensions for laboratory concepts is small as are 
their possible combinations;. 
Research on task hierarchies 

Previous reseerch on task hierarchies (See Brlggs, 1968; Gagne and 
Rohwer, 1969; Glaser and Resnlck, 1972, for reviews of this research) has 
failed to distinguish horizontal from vertical hierarchies. A horizontal^ hier- 
archy Is one within a single level of learning. I.e. , a hierarchy consisting 
entirely of concept-classification or prlnclple-iule-using tasks. The Gagne 
and Merrill taxonomy (Gagne, ?t970; Merrill 1971a/l971b) suggests a vertical 
hierarchy in that there Is always some discriminated recall behavior prereq- 
uisite to any classification behavior, some classification behavior prerequlslie 
to some rule using behavior, etc. With one exception (Wang, Resnlck, and 
Boozer, 1971), all of the studies cited by Glaser and Resnlck (1972) are 
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horizontal hierarchies* Wang, Resnlck and Boozer (1971) Investigated skills 
in a math curriculum and found that if S_ can match an Integer to a set of an 
appropriate size (concept-classification), that he can also read the Integer 
name shown the figure (paired associate-discriminated recall). However, this 
study did not demonstrate that can name numbers without being able to 
match this symbol with a given set. 

Sudweeks and Merrill (1971a) Investigated misconception errors on a 
defined concept resulting from misconceptions present In the attribute concepts. 
The task was to Identify unencountered nonsense words which are "frams. " 
A fram is a single syllable word ending In a simple consonant, preceded by 
a single vov/el, preceded by one or more consonants. Ss were pretested on 
their ability to identify consonants and vowels. All S^s who already knew when 
w and £ were vowels, that gu represents the consonant blend kw, or that x 
represents the consonant blend ks,, were eliminated from the study. Ss In 
different groups were taught none, one, or a combination of the above attri- 
bute exceptions and then all ^s were taught the concept "fram" using an 
expository-generality followed by an inqulsltory-lnstance presentation. All 
Ss who were taught none or only one exception made misconception errors 
completely consistent with the attribute misconceptions which had not been 
corrected. Correcting one of the possible misconceptions did not correct for 
other misconceptions possessed by a given S. This study provides some evi- 
dence for a vertical hierarchy. 

' Scandura (1966a) investigated the effect of different kinds of 

ERLC 



41 

prerequisite training on the ability to use an algorithm (rule) to solve a prin- 
ciple rule-using task. The D-set consisted of problems made up of cards 
containing two geometric figures (circles, triangles) which can each have two 
values (e.g., black or white) on three dimensions (color, size, shape), where 
each card Is labeled +all, -all, +1, etc, , to Indicate the number of relevant 
symbols In an associated symbol set (see Scandura, 1964). The R-set con- 
sisted of symbol sets where one or more can be associated with all three 
cards In a given problem. The operation was left unspecified but all S^s we:^** 
taught to use an algorithm (search strategy) for determining the associated 
symbol set (s). Treatments varied the kind of prerequisite training. This 
prerequisite material consisted of three tasks: a paired associate task, 
where the behavior was discriminated recall of the symbols (Si, Li, C2, etc.) 
associated with the attributes of figures on the cards; a concept task where 
the behavior was to classify Instances of "+aH" symbol sets; and a second 
concept requiring the classification of '*+l" symbol sets. The symbol group 
(S) was taught the discriminated recall of the symbols; a second group (SC), 
In addition to the material taught to group S, was taught the "+air' and 
concept tasks. A third group (P) was taught all the material shown to groups 
S and C and was also shown sample problems, A control group was given no 
pretralning. All groups were then taught an algorithm (search strategy) for one 
type of problem. The dependerv: variables were the attempted solutions of 
six problems; two within the scope of the algorithm, two within the scope, 
but requiring slight variation In the algorithm, and two extra scope problems 
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requiring considerable variation in the algorithm. On the four within scope 
problems, groups SC, and P Identified significantly more correct sets than 
did the control group. On the two extra scope problems, group S did not do 
any better than the control group; however, groups SC and P correctly Ident- 
ified more symbol sets than group S. There was a significant drop in perfor- 
mance for all the experimental groups on the four problems Involving either 
slight or considerable variation In the algorithm. 

In a more extensive second study, Scandura (1966b) again varied the 
mount and kind of prerequisite material. In addition, he also varied sequence 
and amount of practice. The dependent variables included performance (number 
of correct sets and time) on seven practice problems as well as performance 
on two extra scope transfer problems. Groups which were pretralned on the 
paired associate symbol task and the 'Hall" concept task did significantly 
better on the rule-using task and the extra scope problems than did groups 
which were not pretralned. Sequence and practice did not have marked effects 
compared with the effect produced by the kind of pretralnlng. ^oth of these 
studies lend considerable support to the necessity of acquiring relevant 
paired associate-discriminated recall and concept/classification behavior 
before undertaking principle /rule-using tasks. 

Much more needs^to be done on the study of vertical hierarchies. 
Scandura (1966 a, b) did not systematically Investigate all of the prerequisite 
concepts In his task. He did not demonstrate that£s could have the concept 
and still be unable to use the rules. Sudweeks and Merrill (1972) capitalized 
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on widespread, overlearned misconceptions. Would the same results follow 
in teaching a new concept-principle hierarchy where the concepts were new 
to the student and where the rule was taught but not all of the component 
concepts? If the hypothesis of the content-behavior hierarchy Is to be es- 
tablished. It must be demonstrated that S^s can demonstrate adequate class- 
ification of component concepts but be unable to use the rule; be able to use 
some rules, but still not determine the operation for new D-sets. Questions 
such as the following have not yet received adequate Investigation: Do the 
columns in Figure 1 represent prerequisite behaviors for each content-behavior 
combination on the diagonal In a given column? What are the prerequisite 
discriminated recall behaviors for concept-classlfication-recall of the def- 
inition (relevant attributes) or recall of encountered instances? Can It be 
demonstrated that S can possess the prerequisite but not the subsequent 
behavior in a given column? Are the behavior-content categories exhaustive 
or do other categories or subdivisions need to be Introduced? 
Presentation Form 

Generalities Alone versus Generalities Plus Instances . Several studies 
(Guthrie and Baldwin, 1970; Merrill and Tennyson, 1972b; Anderson and Kulhavy, 
1972; Watts and Anderson, 1972) have compared combinations of EG, Eeg,>nd 
leg presentations. The general conclusion is that being presented examples 
(Eeg) or asked to identify examples (leg) following a presentation of the def- 
inition is superior to a presentation of either the definition or examples alone. 

Guthrie and Baldwin (1970) taught intercity fifth graders the concepts 
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"a" before a consonant word and "an" before a vowel word. Groups differed 
In that one group was shown and asked to recall the definition (EG-IG). The 
other group was also given practice in identifying instances (EG-IG-Ieg). On 
tests requiring S to recognize and produce the correct form, there was no 
difference for high ability Ss, but low ability Ss did better after practice at 
classification. 

In a concept task teaching trochaic meter to college Ss, Merrill and 
Tennyson (1972b) compared various types and combinations of presentations. 
Treatments Included definition only (EG); examples and nonexamples (Eeg); 
and definition followed by examples and nonexamples (EG-Eeg) . The com- 
bination treatment Eg-Eeg was superior on correct classification to either 
presentation In isolation. EG or Eeg in isolation are not significantly different 
from each other, but both produced significantly more over-generalization errors 
than did the combination. 

Anderson and Kulhavy (1972) presented S,s definitions of Infrequently 
appearing words. One group was required to use the word In a sentence (leg) , 
while the other group read the definition three times (EG). The test consisted 
of multiple-choice questions where the stem was the concept name and the 
alternatives were descriptions of specific positive and negative Instances. 
Ss who were required to use the word in a sentence performed better on the 
classification test than did Ss who merely read the definition aloud three times. 

Watts and Anderson (1971) conducted a prose learning study which 
compared three types of inserted questions: questions requiring S^to Identify 
O 
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an unencountered example of the concept when given its name (classification), 
questions requiring identification of an example previously used in the text 
(instance recall) and questions asking S to identify the scientist associated 
with a given concept (discriminated recall) . There were five passages each 
defining, presenting two illustrations, and identifying the scientist associated 
with the concept. One of the three types of questions followed each passage. 
The posttest consisted of all three types of questions. The classification 
group did better on all types of questions than did the other groups. The group 
with inserted discriminated recall questions did worst. The classification 
group also took less time to complete the test than the other groups. 

The studies cited do not adequately compare the main effect variables 
of expository versus inquisltory or generality versus instance. Most studies 
in the literature are comparing combination treatments which make the adequate 
determination of the relevant contribution of these variables difficult. The 
limited number of studies where Inferences can be drawn needs to be iepll- 
cated for other tasks and with other populations before we would be willing 
to state propositions Including these variables. Often these studies (e.g. 
Guthrie and Baldwin, 1970 and Merrill and Tennyson, 1972b) are confounded 
in that one treatment Includes more material than another and consequently 
allows for more practice. Additional research is needed of the following type: 
(1) Direct comparisons of expository versus Inqulsitory and generality versus 
Instance In two-way designs which include adequate controls for increased 
practice, number of examples, and use of nonexamples. (2) Sequence studies 
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In which one variable is presence or absence of the generality, a second 
variable is expository-inquisitory sequence (Eeg leg versus leg Eeg) and a 
third variable is repetition of the same instance versus practice with different 
instances. (3) Multiple generality studies which compare presenting the 
generalities first and then instances for the whole set (EGj EG2 EG3 eg. eg2 
egg) versus presenting instances following each generality (EGj egj EG2 eg2 
EG3 egg). Studies would need to compare both expository and inquisitory 
modes for presenting examples and repetition of a single example versus 
several different examples. (4) Studies comparing the minimal instance set 
necessary to logically eliminate Irrelevant attributes with a student selected 
set. These studies should look at aptitude variables which may Interact with 
the Instance set chosen. (5) Studies Investigating the ratio of examples to 
nonexamples. (6) Studies which allow the learner to Indicate what he v^ants 
to see next, a worked example (Eeg), a practice example (leg), or a generality 
(EG) as well as when he wants to see or try another example compared with 
linked controls. (7) Studies which compare learner-paced Inspection time 
with group or machine paced times. There are studies In the literature which 
Investigate some of these variables In memory level tasks but almost no re- 
search on higher cognitive behaviors. 
Interdlsplay Relationships 

Generality and Instance Scope . A series of experiments (Craig, 1956; 
Kersh, 1958; Haslerud and Meyers, 1958; Gagne and Brown, 1961; Kersh, 1962; 
Wlttrock, 1963; Guthrie, 1967; Worthen, 1968) Investigated "discovery learning" 
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using principle/rule using tasks consisting, In most studies, of either rules 
for summing number series or rules for deciphering cryptograms. The dis- 
covery treatment was usually some form of Inqulsitory Instance (leg) prei^en- 
tatlon with or without mathemagenlc information In the form of hints or attributes 
Isolation. This lEG treatment was compared with an expository-generality 
(EG) presentation of the specific rules required for solving one class of 
problem. In most studies, Ss were tested with similar (wlthln-scope) prob- 
lems and also with problems of the same type, both which required a dif- 
ferent rule than the one taught (extra scope problems). The usual finding 
Is that, when compared to Ss receiving an Eg-Ieg presentation, S^s receiving 
some form of leg presentation first do worse on within scope problems, es- 
pecially on an Immediate test; but do better on extra scope problems, espec- 
ially after a delay Interval. 

In a problem- solving task where different number series comprised the 
set of D-sets and where the operations set Is comprised of the summing for- 
mulas for each series, Roughead and Scandura (19B8) compared the expository 
presentation of a general derivation rule for determining the appropriate formula 
for a given series (EGj) with the expository presentation of specific rules 
Indicating the summing formula .tor a given series (EG2) and with an Inqulsitory 
procedure requiring the student to derive the formulas for several series (IG2). 
The dependent measurois were weighted scores combining the time and the 
number of hints required to derive specific rules for unencountered wlthln- 
sccpe and extra-scope problems. On both the wlthin-and extra-scope problems, 
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EG^ and IG2 were not significantly different from each other, but both groups 
performed more efficiently than EG2 or a combination treatment where IG2 
followed EG2- It was concluded that what Is learned In the discovery (IG2) 
situation Is the general derivation rule (Gj) and that an expository presentation 
of the specific rules (EG2) prior to discovery (IG2) limits the student's tend- 
ency to discover the more general rule. 

Paul Merrill (1972) taught Ss to use rules of an Imaginary science 
under four conditions: Eeg-Ieg, where Ss were given an example which 
demonstrated the application of the rule (expository-instance) and were then 
asked to solve three additional examples of the same type (inqulsitory- in- 
stance). If they solved two out of three, they were given an example of the 
next rule. If they did not, they were given another solved Instance of the 
first rule plus three additional problems. The pattern was repeated up to five 
times for a single rule for ten mles. (EG-rule Eeg) - leg Ss were shown a 
stated rule simultaneously with the first solved example; (EG-Objective-Eeg) - 
leg S,s were shown an objective simultaneously with the first solved example; 
(EG-both Eeg) - leg Ss were shown both the objective and the rule. The de- 
pendent variable was the number of examples required to learn the task. Those 
S,s who received rules required fewer examples; and learned the task in less 
time than those not receiving rules. There was no difference for obfectives. 
Unlike previous research on discovery, however, the rule groups did better 
on a transfer test. This finding is consistent with Roughead and Scandura 
(1968) in that when the rule is general and Ss are given practice with a variety 
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or problems then transfer Is better for EG group than for leg groups. 

Scandura, Woodward and Lee (1967) Investigated rule and Instance 
scope In a prlnclple-rule-uslng task consisting of NIM games (a mathematical 
game where two players alternatively pick numbers from a given set, the first 
play to pick the number which exactly reaches a predetermined sum wins). 
The D-set consists of specifications for the number set and winning sum, the 
operation is a rule which allows the first player to win the game. The Invest- 
igators compared a general rule (G), which applied to any game, with a par- 
tially specific rule (SG) , which applied to (6, m) games, with a specific rule 
(S), which applied only to (6, 31) games. Two control groups were Included; 
one received only a worked example (Eeg), the other received no instruction, 
only the test. The dependent variable was the number of Ss who used an 
•appropriate procedure on three NIM games where the first was a wlthln-scope 
Instance for all three rules, a (6, 31) game; the second was wlthin-scope 
for G arid SG, but extra-scope for S; the third was within-scope for G, but 
extra-scope for S and SG. The results show that the S rule was easier to 
apply than SG or G; that there was no extra-scope transfer; that if S applied 
the rule he was taught on problem 1, he used the same rule on problems 2 and 
3 even though it was Inappropriate on the extra-scope transfer problems. 

Scandui^a and Durnln (1968) extended this study by comparing a re- 
stricted general rule (GO which is stated In terms of a specific case, with 
a general rale restricted In one dimension and specific in the other (SG*) and 
with a specific rule (S') which applies to only one specific NIM game. Specific 
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rule S^s were unable to solve any extra-scope problems, two out of 22 SG' Ss 
solved the extra-scope problems, only two G' Ss were able to solve one of 
the problems which were extra-scope for the other groups, but supposedly 
wlthln-scope for them* When a restricted general rule is used, there Is 
some transfer to the general case for some S_s, but not as much as one would 
hope. Additional research needs to address the question^ "What procedures 
could be used to promote wide spi°ad application of a general rule?" 

Roughead and Scandura (1968) and Paul Merrill (1972) pointed out that 
previous "discovery" studies used a restricted rule and measured transfer 
on extra^-scope problems while they used a general rule and hence were looking 
at performance on within-scope problems. If these studies had been concept- 
ualized with these variables In mind, much confusion may have been elimi- 
nated. Further replication and extension Is necessary to determine if an 
expository presentation of a general rule is always superior to Inqulsitory 
I)resentatlon of instances. Several questions have not been resolved* (1) 
Can set functlondsacrlptlons be applied in the humanities as well ds to math 
science type subject matters? If so, is the expository presentation of a 
general generality the superior procedure? (2) If a general generality cannot 
be determined are there alternative ways to facilitate extra-scope transfer? 
The authors would hypothesize, generalizing from their concept research, that 
presenting a variety of expository generalities each followed by Inqulsitory 
Instance practice would result in better extra-scope transfer than the inquis- 
itory Instance ("discovery") practice alone. 
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Scandura and his associates have consistently found that reshrlcted 
rules are easier to learn but promote less transfer. A challenging research 
question Is how to teach general generalities. Several questions need Invest- 
igation. (1) Will a restlrcted to general generalities presentation prove 
better than presenting the general generality at the beginning assuming one 
controls for amount of Inqulsltory Instance practice. (2) Is presenting (EG) 
a variety of restricted generalities each followed by Inqulsltory Instance 
practice more effective than the repeated presentation (EG) of a more general 
generality followed by the same Inqulsltory Instance practice? Generality 
and instance scope has received such minimal resea'ich attention that consid- 
erable work is necessary before one will be able to state prescriptive prop- 
ositions that will assist Instmctlonal development. 

At tribute Matching and Instance Difficulty . Tennyson (1972) taught 
seventh grade Ss the concept adverb. His treatments manipulated attribute 
matching and instance difficulty (empirically determined by Instance proba- 
bility analysis). His dependent variables were correct classification (number 
of unencountered Instances correctly Identified) and three predicted error 
patterns: overgenerallzatlon (Incorrectly Identifying low probability non- 
examples as examples), undergenerallzatlon (failure to Identify low proba- 
bility examples as examples) and misconception (focusing on an Irrelevant 
attribute thus falling to correctly Identify examples not having this attribute 
and Identifying as examples some nonexamples which do share this attribute). 
The combination treatment producing the best correct clasrlflcatlon consisted 
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of examples matched to nonexamples, examples divergent with other examples, 
and a range of high to low probability Instances. Overgenerallzatlon resulted 
when examples and nonexamples were unmatched and all low probability 
Instances were used. Undergenerallzatlon resulted when only high proba- 
bility Instances were used. Misconception resulted when examples were 
not matched to nonexamples and examples were convergent on the Irrelevant 
attribute of an -ly ending. All predicted outcomes were significant beyond 
p<.001. In a second experiment, a parallel set of treatments eliminated 
all nonexamples. In this study, performance on the test demonstrated random 
responding which did not differ from a control group, which received no In- 
struction. Contrary to findings using laboratory concepts, when appropriately 
matched to examples, nonexamples are apparently a critical part of instruction 
on "real world" concepts. In an earlier study, Tennyson, Woolley and Merrill 
(1972) found the same results using college Ss and the concept trochaic meter. 
Merrill and Tennyson (1972a) also replicated these results using college S.s 
and the concept RX2 crystal structures. 

Using a rule using task which taught sixth grade children graphical 
Integer additlpn, Traub (1966) Investigated problem hetrogenelty (divergent 
instances). The three treatments Included a heterogeneous (divergent) pro- 
blem group, a homogeneous (convergent) problem group, and a control group 
which worked irrelevant problems. The dependent variable was performance 
on 26 unencountered divergent problems using both arrow length and correct 
Integer answer as measures. The heterogeneous problem group demonstrated 
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superior performance . 

In a problem solving task where the set of D-sets consist of n-tuples 
(sets of 3, 4, or 5 Integers, e.g., 3, 2, and 7); the operations set consists 
of two arithmetic operations, (+, 7, and x) for combining three of the n 
Integers In an n-tuple; and the response set consists of the resultant Integers; 
Scandura and Voorhles (1971) Investigated the effect of the number of irrel- 
evant operations and the number of Irrelevant Integers (attributes) on Instance 
difficulty. Students were told that two operations were to be used out of two, 
three, or four possible operations and that three out of three, four, or five 
Integers In an n-tuple were to be combined by these operations. A linear 
relationship was found In that one Irrelevant operation or one Irrelevant Integer 
was more difficult than none; both one Irrelevant operation and one Irrelevant 
integer were more difficult than one or the other; etc. The effect was more 
pronounced for Irrelevant Integers than for Irrelevant operations , probably 
because Ss could predict likely operations from the size of the response terms. 
Just as the number of irrelevant attributes Increases the difficulty of correctly 
Identifying an Instance of a concept (see Clark, 1971), so also Increasing 
the number of attributes and/or operations increases the difficulty of correctly 
solving a problem. This finding represents a way to Identify Instance dif- 
ficulty but Is a variable that cannot usually be manipulated In teaching real 
world concept or problem solving tasks. 

Markle and Tlemann (1972) Investigated various types of definitions 
and their effect on Instance difficulty. Using the concept morpheme they 
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found that a definition consisting of the critical relevant attributes or one 
which also included technical irrelevant attributes was superior to definitions 
including nontechnical Irrelevant attributes (typical of texibook definitions). 
Students In a control group who received Webster's definition performed least 
adequately. 

The research cited has exciting implications for Instructional design 
and does suggest the following proposition for concept instruction. I Ldurlng 
practice / using either expository or inquisitory instance presentations, ex- 
amples are divergent from examples and matched to simultaneously or se- 
quentially presented nonexamples then correct classification of subsequent 
unencountered instances is more probable . Correlarles can be stated indi- 
cating specific classification errors resulting from other relationships. While 
this research is promising, much replication with other concepts and popu- 
lations is necessary. Some yet unanswered questions deal with interactions 
of presentation mode and attribute matching. Under what conditions is sim- 
ultaneous superior to sequential presentation? How does one most effectively 
teach sets of concepts versus a single concept? Are the examples of one 
adequate nonexamples of the other? 

Attribute matching and instance difficulty have been almost completely 
neglected in research on rule using and problem solving. Critical questions 
yet to be resolved Include the following: What is a nonexample of an operation 
in a'rule-uslng task? Is it an incorrect solution? Which should be matched 
R-set (range) ,\)-set (domain), or operation? What determines difficulty, the 
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D-set, R-set or operation? For rule using what are equivalent errors to 
misconception, overgenerallzatlon, and under^enerallzatlon? Considerably 
more work is necessary before we would wish to attempt propositions In this 
area, 

Mathemaqrentc Information , 

Attribute Isolation-Prompting , Using the concept trochaic meter, 
Merrill and Tennyson (1972b) Investigated attribute Isolation in a prompted 
sequence. The procedure was a definition (EG) presentation followed by 
divergent sets of examples matched to nonexamples (Eeg) . In the prompted 
attribute isolation group, poetry passages were marked with scansion symbols 
indicating stressed and unstressed syllables and accompanying comments 
which pointed out discrepencies such as masculine endings • Groups receiving 
the prompted passages performed significantly better than the unprompted 
groups on a correct classii'lcatlon test using new unencountered examples. 
Unprompted presentation of instances tended to produce more overgeneral- 
lzatlon errors than the prompted presentation. 

Attribute Isolation-Feedback . Young, Smith and Merrill (1972) investi- 
gated specific review (attribute isolation feedback) using the trochaic meter 
concept task. Ss were given the- definition (EG) followed by unidentified 
positive and negative instances (leg) . After responding, experimental S^s 
were told whether their answer was correct and were shown the passage vi.th 
the stress pattern indicated together with an explanation calling attention to 
unusual patterns. Control Ss were merely given correct answer feedback. 
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The specific review groups had higher correct classification scores than the 
controls. The no review groups made more overgenerallzatlon errors. 

Algorithms "Feedback . In a series of studies (Merrill, 1965; Merrill 
and Stolurow, 1966; Merrill, Barton, and Wood, 1970; Merrill, 1971), using 
a complex Imaginary science, the Investigators explored algorithm feedback 
on rule using questions. The task Involved a hierarchically related set of 
principles for predicting speed and position of satellites In a Xenograde sys- 
tem. Problems required rule using In unencountered problem situations. The 
task consisted of five programmed lessons, each f^^UoWed by a quiz, lu the 
Merrill, Barton, and Wood (1970) study, specific review was given following 
each missed question during the lessons. No feedback was given on lesson 
quizzes. Specific review consisted of a step-by-step presentation of the 
.rule(s) required to solve the problem presented. This represented a restricted 
presentation of the general rule presented during the Instruction. The feed- 
back was complex, also Involving attribute Isolation on some frames. Spe- 
cific review following incorrect responses Increased efficiency (time spent 
on each frame In subsequent lesson), while the number of errors made on 
quizzes and the terminal test remained the same. The overall time required 
to learn the task was less for specific review S^s even though they were 
presented approximately 30 percent /liore material. 

Prompting and feedback (K of R) have received considerable attention 
primarily using tasks which require discriminated recall behavior. However, 
very little has been done to systematically Investigate these variables for 
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tasks which require higher cognitive behaviors. While previous work has 
concentrated on response prompting or feedback the research cited suggests tiat 
ma themagenic information which isolates stimulus attributes is more promising. 
Many questions r-emain to be answered including the following: Are prompting 
and feedback equivalent procedures? Is stimulus directed mathemagenlc infor-* 
mation more effective than response directed information? Is there an inter- 
action? 

Algorithms have tremendous promise as a powerful instructional tool. 
Work on mnemonics (see Bower 1970; Rowher 1970) in memory tasks are sure 
to have parallels in higher order tasks. Directions for processing Information 
(search and production strategies) may prove to be the most powerful instruc- 
tional tools available. More adequate definition Is required for such strategies 
as well as questions dealing with removal of mathemagenlc information, prompt- 
feedback ratios, student requests versus program provision of mathemagenlc 
Information, schedules of feedback-wrong, right or both, and other similar 
questions. 

Implications of a Task Variable Taxonomy for Instructional Development 

Instructional developers are often unable to profit from the efforts of 
their colleagues because it Is difficult for other instructional developers to 
unambiguously describe their products or for Instructional researchers to ade- 
quately describe their experimental treatments. The proposed task variable 
taxonomy enables an Instructional product designed to promote higher cog- 
nitive behaviors to be unambiguously described thereby facilitating 
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communication and comparison of Instructional treatments* Each segment can 
be Identified as a combination of exposltory-inqulsltory mode and generality- 
Instance content; each generality and Instance can be described In terms of 
their relationship to other generalities and Instances within the treatment; 
and any mathemagenlc information can be identified. With the appropriate setecttn 
of symbols it would be possible to completely describe a given Instructional 

strategy In a very limited space with less ambiguity than is usually present 

4 

in pages of description. For example, the following shorthand: Concept: 
EG, XEG, 3df Eeg, legfegm ("Eeg/ff9m)iAidf . describes a concept treatment 
which consists, first, of an expository presentation of the definition (EG). 
This display Is followed by further expository explanation of the definition 
such as paraphrase or analogy (expanded generality XEG) . The third display 
consists of a series of three divergent (d) exemplars (eg) arranged in ascending 
difficulty order ("f) using a prompted (-^) expository (E) presentation. The 
fourth display will provide an opportunity for £ to identify (inquisitory I) 
which of a matched (m) exemplar (eg) nonexemplar'(5g) pair Is a member of the 
concept class Cleg/sgm). If he makes the Inconr^ct choice (-...) he will be 
presented a prompted expository comparison of the matched exemplar non- 
exemplar pair as feedback (-Eeg/egm) • The delta ( A) indicates that has the 
option to try as many choices as he feels necessary. Each successive matched 
exemplar and nonexempl^r pair will be matched to each other but divergent (d) 
from the previous pair and In ascending order of difficulty (+), Unless other- 
wl:>e Indicated/ the definition Is not restricted and all Instances, are within 
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scope. The above explanation Is still shorthand based on the previous de- 
scriptions In this paper. A standard, nonshorthand description of this In- 
structional treatment would take several paL^es and If typical of such descrip- 
tions already in the literature would still be Incomplete and ambiguous. 

A taxonomy of task variables suggests a lesson component approach 
to Instructional development by making the distinction between content com- 
ponents and instructional components less^amblguous . The content for a task 
designed to promote higher cognitive behavior consists of four files (sets) of 
information. A generality file consists of a precise statement of each def- 
inition, rule^ or higher order rule to be taught. An expanded generality file 
consists of further explanations of each of these generalities and can take the 
form of restricted generalities^ paraphrased definition or rule statements, 
analogies, and warnings to avoid certain pervasive Irrelevant attributes or 
procedures. Each generality should be accompanied by an Instance file that 
consists of exemplars and nonexemplars of a concept or problems to which 
the operation of a rule or higher order rule can be' applied. To be complete 
this file should consist of matched exemplar nonexemplar pairs, divergent 
instances, and a range of difficulty. Each Instance file should be accompanied 
by a mathemagenlc information^ file that consists of each Instance or instance pair 
with the appropriate attribute Isolation or algorithm applied. There may be 
one or more such displays for each Instance or instance pair, These four 
flies represent the basic content components of any lesson designed to teach 
higher cognitive behavior and can be combined into numerous instructional 
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or evaluation strategies. 

An evaluation or Instructional strategy Is constructed by combining 
the various comblnatlais of the qualitative task variables with the quantitative 
parameters Identified In the task variable taxonomy. A very large variety of 
such strategies are possible and the taxonomy makes an unambiguous des- 
cription possible as well as suggesting consideration of variables which 
otherwise might be left to chance. 

Once a strategy has been selected It Is necessary to prepare two 
types of management displays. The first are control displays which provide 
directions to the student as to how to proceed, the options which are avail- 
able to him, cumulative Information about his performance, and other 
directions which enable him to Interact with the instructional system. The 
second type of management display Is wrap-around that consists of those 
questions and directions necessary to present a given generality or Instance 
to the student. These wrap-around displays often take the form of patterns 
In which a number of different instances can be inserted and which provide 
directions as to how the student is to proceed. 
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Summary 

Five premises necessary for the formulation of Instructional theory 
are stated. As a suggested elaboration of the **behavlor classification" 
premise a two-way (content and behavior) classification scheme for higher 
order tasks is described. The content dimension Includes paired associate, 
concept, principle, and problem tasks. The behavior dimension includes 
discriminated recall, classlflcai..on, mle using, and higher rule using. Each 
two-way category Is Illustrated by treatments from recent research on higher order 
tasks. As a sugg jted elaboration of the *' manipulation of task variables" 
premise a taxonomy of task variables Is de-scribed. The taxonomy is divided 
Into qualitative variables and quantitative parameters. The qualitative var- 
iables Include the major categories of presentation form, Interdlsplay rela- 
tionships, and mathemagenlc Information. Specific variables are Identified 
in each category. Parameters Include major categories of sequence, quantity 
and pace - specific parameters are Identified for each category. The variables 
In the taxonomy are illustrated by treatments from recent research on higher 
order tasks. Research Investigating some of the variables in the taxonomy is 
described and critiqued. Some additional needed research is suggested. A 
final section indicates implications of this research and the task taxonomy 
for Instructional development. 
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Table 1 

Classification of Task Variables for 
Promoting Higher Cognitive Instructional Outcomes 
I. Qualitative Variables 

A. Presentation Form 

1» Presentation Mode 

(E) Expository (telling) - (I) Inquisltory (asking) 

2. , Presentation Form 

(G) Generality (definitions or rules) - (eg) Instance 
(positive or negative examples or problems) 

NOTE: Complex cognitive instruction is composed of displays, each represent- 
ing one of the following combinations: 

1. Expository Generality (EG) 

2. Expository Instance (Eeg). 

3. Inquisltory Generality (IG) 

4. Inquisltory Instance (leg) 

B. Interdlspiay Relationships 



1, Generality Scope (Restricted General) 

Relationship of generalities to generalities 

2» Instance Scope (Within Scope - Extra Scope) 
Relationship of Instances to a generality 

3. Attribute Matching (Matched - Divergent) 
Relationship of Instances to Instances 

4. Instance Difficulty (Easy - Hard) 

Relationship of Instances to a given population of students 

C. Mathemagenlc Information 

1. Correct answer (Yes - No) 

2. Attribute Isolation. (Yes - No) 
3 . Algorithm (Yes - No) 
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NOTE: Prompting Is mathemagenic information presented prior to S.s respond- 
ing to an inqulsitory display. Feedback is mathemagenic Information 
presented following Ss response to an Inqulsitory display. 
II. Quantitative Parameters 

Any quantitative parameter can be applied to any qualitative variable. 

A. Sequence 

1. Order (which comes first?) 

2. Schedule {sequence patterns) 

3. Simultaneous versus sequential 

B. Quantity 

1. Number (how many?) 

2. Ratio (in what proportions?) 

C. Pace 

1. Learner versus program 

2. Intervals 
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Figure 1* Two Dimensional Task Classification— Behavior & Content 
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!♦ The diagonal (shaded boxes) are the categories included in the previous Gagne- 
Merrill hierarchy (Gagne 1965, 1970; Merrill 1971). Parentheses are Gagne's terms. 
Italicized words are suggested new terms used in this paper to classify tasks in 
both dimensions simultaneously « 
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Footnotes 

discussion of attribute matching appears later In the paper. 

Math them a gen Ic was coined by Ernest Rothkopf (1955). The roots 
of this word are mathema: learnlngjand gignesthai : to be born. Mathemagentc 
seems appropriate as an adjective which describes behaviors which giv^e 
birth to learning or Information v\tiich is designed to promote thos© behaviors* 
The use of the word here is an extension of Rothfopf's original application 
but it seems consistent with his intent. 

3 

Algorithms are defined as a set of procedures usually Involving a 
repetition of some operation for solving a mathematical problem. The word 
has been generalized In this scheme to refer to procedures for solving any 
kind of problem and Includes both production algorithms and search algorithms. 

4while some symbols have been used for presentation form and others 
suggested for Illustrative purposes here, there has not been an attempt to 
suggest or promote a set of symbol conventions for the variables suggested. 
Such a system will await further development of this taxonomy . 
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